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□ the description, pages: 

□ the claims, Nos.: 
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considered to go beyond the disclosure as filed (Rule 70.2(c)): 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 



1. Statement 



Novelty (N) 



Yes: 
No: 



Claims 
Claims 



1-7, 9-12, 14-21 



Inventive step (IS) 



Yes: 
No: 



Claims 
Claims 



1-7, 9-12, 14-21 



Industrial applicability (IA) 



Yes: 
No: 



Claims 
Claims 



1-21 



2. Citations and explanations 
see separate sheet 

VI. Certain documents cited 

1. Certain published documents (Rule 70.10) 
and /or 

2. Non-written disclosures (Rule 70.9) 
see separate sheet 

VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 

VIII. Certain observations on the international application 

The following observations on the clarity of the claims, description, and drawings or on the question whether the 
claims are fully supported by the description, are made: 

see separate sheet 
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Reference is made to the following document: 
D1: US-A-5617335 



Re Item V 

Reasoned statement under Rule 66.2(a)(ii) with regard to novelty, 

inventive step or industrial applicability; citations and explanations 
supporting such statement 

1 Insofar as the present text of claim 1 can be understood in the light of the 

description (see paragraph 6 to 6.2d below), it appears that present 
independent claim 1 is not new and therefore it does not fulfill the 
requirements of Article 33 (2) PCT for the following reasons. 

1.1 Document D1, that provisionally represents the closest prior art, 

discloses (see column 2 lines 29-36; column 2 lines 54-58; column 3 
lines 1-16; column 4 lines 12-52; from column 4 line 65 to column 5 line 
13; column 9 lines 39 to column 13 line 55; column 15 lines 18-23) a 
method for contactless or touch free measurement of position and 
orientation of a tool or accessories by means of image points on image 
area means, wherein said image points on said image area means are 
based on markers provided on said tool and having predetermined 
mutual positions, and wherein said image area means comprising optic 
means to convert said markers on said tool into said image points on said 
image area means and whereby said markers provided on said tool 
being at least three visible within the field of view of said image area 
means and at least being distinctively identifiable; moreover, in order to 
measure the position and the orientation of said tool, said markers having 
a size large enough and a shape such that said corresponding image 
points on said image area means can be processed in order to restore 
them even though a part of said markers is obscured by some obscuring 
objects. 
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1.2 Thus the method of claim 1 lacks novelty against the method known from 

D1. 

2 Moreover, Insofar as the present text of dependent claims 2 to 7 can be 

understood in the light of the description (see paragraph 7 to 8.1 below), it 
appears that dependent claims 2 to 7 do not contain any features which, in 
combination with the features of any claim to which they refer, meet the 
require- ments of the PCT in respect of novelty (Article 33 (2) PCT) the 
reasons being as follows. 

2.1 Document D1 discloses (see column 2 lines 29-36; column 2 lines 54-58; 
column 3 lines 1-16; column 4 lines 12-52; from column 4 line 65 to column 
5 line 13; column 9 lines 39 to column 13 line 55; column 15 lines 18-23) a 
method for contactless measurement of position and orientation of a tool or 
accessories that comprises all the additional features of dependent claims 
2 to 7. 

2.2 Thus the subject matter of dependent claims 2 to 7 lacks novelty against the 
method known from D1. 



3 Insofar as the present text of independent claim 10 and dependent claims 

1 1 to 21 can be understood in the light of the description (see paragraph 10 
to 10.3 below), it appears that claims 10 to 21 are apparatus claims 
corresponding to the method claims 1 to 9. 

Therefore, because of the similarities in structures the above comments 
apply in their entirety also to present claims 10 to 21. 

3. 1 Thus, it appears that the subject matter of present independent claim 1 0 and 

dependent claims 11,12 and 14 to 21 is not new against the apparatus 
known from D1 and therefore it does not fulfill the requirements of Article 33 
. (2) PCT for the same reasons above mentioned in paragraph 1.1 and 2.1 of 
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this International Preliminary Examination Report. 

3.2 With regard to the assessment of the present claims 1 to 21 on the question 

whether they are industrially applicable, the following is stated. 
The subject matter of present claims 1 to 21 relates to a method and 
apparatus for contactless measuring of position and orientation of a tool, 
therefore it fulfills the requirements of industrial applicability as set out in 
Article 33 (4) PCT. 



Re Item VI 

Certain documents cited 

4 According to Rule 64.3 PCT attention is called on documen t WO-A-9854593 

published on 3 December 1998, which was filed on 29 May 1998 with priority 
dates 30 May 1997 and 2 June 1997. 



Re Item VII 

Certain defects in the international application 
5 At page 5 line 4 the wording "gjoining" should be amended as "joining" 

5.1 At page 13 line 24 the wording "framgrabber" should be amended as 
"framegrabber". 

5.2 At page 16, last paragraph, the description contains general statements that 
the extent of protection may be expanded in some vague and not precisely 
defined way. Such general statements shall be deleted as contrary to Article 
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6 PCT, cf. also PCT Preliminary Examination Guidelines, C-lll, 4.3a. 

5.3 Present independent claims 1 and 10 are not in the two-part form in 

accordance with Rule 6.3(b) PCT, which in the present case would be 
appropriate, with those features known in combination from the prior art 
(documents D1) being placed in a preamble (Rule 6.3(b)(i) PCT) and with 
the remaining features being included in a characterising part (Rule 6.3(b)(ii) 
PCT). 

v ( 5.5 ^ ^ Furthermore, the^( features of the claims are not provided with reference 

signs placed in parentheses (Rule 6.2(b) PCT). 



Re Item VIII 

Certain observations on the international application 



6 The application does not meet the requirements of Article 6 PCT, because 

independent claim 1 is not clear, the reasons being as follows. 

6.1 The wording of present independent claim 1 as a whole is vague and 
unclear and leaves the reader in doubt as to the meaning of the technical 
features to which it refers, thereby rendering the definition of the subject 
matter of said claim unclear (Article 6 PCT). 

6.2 Additional reasons why the subject matter of present independent claim 1 
does not fulfill the requirements of Article 6 PCT is the following. 

6.2a Document D1 discloses a method for contactless or touch free 

measurement of position and orientation of a tool or accessories wherein 
said position and orientation in a three dimensional space is provided by 
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means of four markers placed on a plane and two other markers placed on 
a different plane. 

However, the processing required to carry out the determination of the 
position and orientation of said tool in a three dimensional space when said 
markers are partially obscured results very complex. 



6.2b The method of the present invention seeks a solution the above mentioned f 

problem of the prior art by using an over determined system, wherein two or 
more parallel rows of markers are provided on the same plane of said tool 
and wherein each of said rows of markers includes at least three markers. \ 

6.2c Thus, it is clear from the description that the following additional features are 

essential to solve the above mentioned problem of the prior art according to 
the teaching of the present invention: 

i) at least two rows of markers are provided on the same plane of said 
tool, each of said rows including at least three markers; 

ii) said at least two rows are markers provided on the same plane of said 
tool are parallel. 



6. 2d Since independent claim 1 does not contain these features it does not meet 

the requirement following from Article 6 PCT taken in combination with Rule 
f% 6.3(b) PCT that any independent claim must contain all the technical 

features essential to the definition of the invention. 



7 Claim 2 does not fulfill the requirements of Article 6 PCT for the same 

reasons above mentioned in paragraph 6.1 of this International Preliminary 
Examination Report and for the following additional reason. 

7.1 The wording "lined measuring element" is vague and indefinite and as such 

it does not have a clear technical meaning. 
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8 Dependent claim 3 is also vague and unclear and therefore it does not fulfill 

the requirements of Article 6 PCT for the same reasons above mentioned 
in paragraph 6.1 of this International Preliminary Examination Report and for 
the following additional reasons. 

8,1 Claim 3 attempts to define the subject matter in terms of the result to be 

achieved which merely amounts to a statement of the underlying problem. 
The technical features necessary for achieving this result should be added. 



^ 9 Dependent claim 9 is also vague and unclear and therefore it does not fulfill 

the requirements of Article 6 PCT for the same reasons above mentioned 
in paragraph 6.1 and paragraph 8.1 of this International Preliminary 
Examination Report. 

10 It appears that claims 10 to 21 are apparatus claims corresponding to the 

method claims 1 to 9. 

Therefore, because of the similarities in structures the comments of above 
paragraph 6 to 8.1 of this International Preliminary Examination Report apply 
mutatis mutandis also to present claims 1 0 to 21 . 



10.1 Moreover, dependent claims 11, 12, 19 and 20 are also unclear for the 
following additional reason. 

10.2 Some of the features in the apparatus claims 1 1 , 12, 19 and 20 relate to a 
method of using the apparatus rather than clearly defining the apparatus in 
terms of its technical features. The intended limitations are therefore not 
clear from this claim, contrary to the requirements of Article 6 PCT. 

1 0.3 Thus, it appears that the subject matter of present independent claim 1 0 and 
dependent claims 1 1, 12, 14, 15, 19 and 20 does not fulfill the requirements 
of Article 6 PCT. 
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(57) Abstract 

The invention relates to a method and 
a device for contactless or touch-free mea- 
surement of a tool by means of imaging area 
means (4, 5). Processing means (30) makes 
calculations based on image points on the 
tool, imaged onto the imaging area means. 
Optics (41, 42; 51, 52) presents the image 
of the image points on the tool on the imag- 
ing area means, the processing means (30) 
being adapted to calculate the momentary 
position and/or orientation along at least 
one axis of the tool making use of the im- 
age points. A number of measuring ele- 
ments and/or markers (8, 9; 13-16; 20-23; 
26-28) has predetermined mutual positions 
and are provided on the tool. Each mea- 
suring element and/or marker comprises at 
least one measuring point. At least one of 
the points is identifiable. Each measuring 
element and/or marker to be used as posi- 
tion and/or orientation indicating means has 
a size making it restorable by the process- 
ing means even if a part of it on the tool 
is obscured for the image area means, for 
example by dust. 
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WO 99/21 134 PCT/SE98/01914 

1 

Spectra Precision AB 

Contactless measuring of position and orientation 

5 This invention relates to the contactless or touch-free measurement of position and 
orientation of a tool or accessory, for instance a blade of a road planner, skimmer 
shovel or the like, in relation to the machine provided with the tool. 

Most often indications of the position and orientation of a tool are provided by sensors 
10 and encoders on the moving links and rotational parts of the machine which move the 
tool. However, wear, slippage, complicated installation or the like of the moving parts 
make the indicated results unreliable and also changeable with the passage of time. 

15 DESCRIPTION OF RELATED ART 



Therefore, a method is desired according to which a non-contacting and reliable 
measurement of the momentary position, orientation and movements of a tool could be 
provided. 

20 

A known method, disclosed in WO 96/22537, uses two cameras having frame grabbers 
to measure the distance to, and the speed of, a moving target. The mathematics of the 
triangulation calculation to provide the distance to a point of the target are analysed, as 
well as the target speed from consecutive distance measurements. However, it is 
25 assumed that the target is moved along a straight line from the cameras and only one 
point on the target is measured. 

A calibration frame for a non-contact measurement systems is disclosed in WO 
96/07869. At least two cameras are intended to view an object in order to determine 
30 the shape or other geometric properties of the object. A calibration frame having 
individually controllable light emitting diodes (LED) is arranged in view of the 
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cameras. One LED at the time is switched on and the space co-ordinates for the LED 
in question is stored with the image co-ordinated data for that LED. This process is 
repeated for all the LEDs on the frame. Thereafter the computer in the system has all 
the data required to perform calibration of the measuring system so that measurements 
can be made. It is to be noted that a stationary system is disclosed in this patent 
application. 

US 440 392 describes a system for point to point measurement of spatial co-ordinates 
of a touch probe provided with at least three point-sized light sources. The spatial 
direction to all the light sources of the touch probe are registered simultaneously on at 
least one 2D (two dimensional) matrix of photosensitive elements. Calculation is made 
of the spatial direction for each individual light source. Calculation of the spatial co- 
ordinates for the touch probe is then provided. 

US 4,396,945 describes a method of detennining the position and orientation of an 
object in space by use of two cameras which are tumable by servo control to be 
directed towards the object and record images light sources on the object. The 
intersection of the lines in space from the cameras towards the object is used to 
determine the position of each light source in space. 

US 4,044,377 describes a target locator to measure the vertical and longitudinal 
distance from an industrial robot are by means of a closed circuit TV camera with a 
fixed focus lens. The robot arm is provided with a row of alternate black and white 
squares. This pattern is identified by the appearance of a burst of pulses in the video 
output during a horizontal scan across the uniform pattern. The vertical displacement 
of the target pattern is obtained by averaging the vertical deflection voltages, when the 
pattern is first acquired by a horizontal scan and when the pattern is just lost. The 
longitudinal distance to the target is obtained from the pulse repetition frequency from 
the horizontal scan across the partem on the camera display. 
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US 4,764,668 describes a system for performing a safe docking procedure in the clean 
space. Two pairs of bar codes are positioned along each one of two orthogonal lines 
going across an opening to a space ship. The position of the space ship and the 
orientation of it is determined by aid of the bar codes. 



OBJECTS OF THE INVENTION 

One object of the invention is to provide a method and system to make a reliable and 
io exact measurement of the momentary position and orientation of a tool or accessory in 
relation to the body of a machine provided with the tool. 

Another object of the invention is to provide a method and a system to make a 
contactless measurement of a tool or accessory in relation to the body of a machine. 

15 

Yet another object of the invention is to provide a method and a system to make exact 
measurement of the momentary position and orientation of a tool or accessory 
provided in a dirty and dirtying environment. 

20 Still another object of the invention is to provide a method and a system which is 
easily installed to make reliable measurement of the momentary position and 
orientation of a tool or accessory in relation to the body of a machine. 

Yet another object of the invention is to provide a method and a system to make a 
25 contactless measurement of a tool or accessory in relation to the body of a machine at 
short intervals in order to indicate the momentary speed and acceleration and the 
direction of them for the tool or accessory. 



30 
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THE INVENTION 

These objects are achieved by a method having the features in claim 1, and a device 
for performing the method is disclosed in claim 11. Further features and improvements 
of the invention, are disclosed in the dependent claims. 

The invention relates to the technical field of contactless or touch-free measurement 
of a tool or accessories by means of at least one imaging area means and calculation 
indicating the position and/or orientation of the tool making use of image points on the 
imaging area means, based on the image points having predetermined mutual positions 
provided on the tool imaged onto the imaging area means, and optics presenting the 
image points on the tool on the imaging area means, the image points being at least 
three visible within the field of view of the imaging area means and at least one being 
distinctly identifiable. 

The invention is characterized by, in order to measure the position and/or orientation 
of the tool, providing a number of measuring elements on the tool, each measuring 
element having a size large enough for making a reconstruction of its form and 
calculation of at least one image point on the tool related to the measuring element 
even though a part of it happens to be obscured by some obscuring object, for example 
dust. 

Each marker has a two-dimensional shape and its point of balance, i.e. the centre-of- 
gravity of a disk having the same design and a uniform thickness, is detected and is 
used as its measuring point. Each measuring object could be derivable as a point of a 
marker positioned on the tool surface. Most of the markers could have the same shape, 
for instance circular, and at least one of the markers could have a shape different from 
the others, for instance a square, clearly distinguishable in the imaging areas, each said 
differently shaped marker having a predetermined known position on the tool and 
providing a reference point for determine shift position. The calculated consecutive 
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positions in space of at least one of the differently shaped markers could be used as the 
basis for calculating the shift of the tool. 

Preferably at least some of the measuring objects, called lined measuring objects, are 
positioned on at least one row; and that for each row at least one line in space gjoing 
through the lined measuring objects for the row in question is determined. Several 
measuring objects are preferably present along each row. Calculation of at least one 
line per row is preferably made using at least three of them, but preferably several, on 
each image area having known mutual distances on the tool in order to determine the 
equation of the line and the positions of the measuring objects. 

Using the modern computers nowadays having a great computing capacity the markers 
can be positioned also in an arbitrary design, but the best result will be provided if the 
markers are placed along lines extending from one short end side of the tool to the 
other. Thereby, each line can be viewed from each imaging area. Preferably, the rows 
are parallel to each other, because then the calculations of the rotations in different 
directions of the tool are easy to make and be programmed on a computer. However, it 
is also possible to have two lines crossing each other, for instance going diagonally 
over the tool and crossing each other in the middle between the short end sides, or the 
like. 

Consecutive measurements of the markers could be provided, each measurement 
resulting in calculation of the tool 3D position, and further calculations are performed 
to calculate the 3D movements of tool from calculation to calculation and thereby to 
calculate at least one type of movement, such as shift, rotation etc. 

At least two rows of markers are preferably provided on the tool, particularly when the 
tool can be moved both in all cartesian directions and turned around all the cartesian 
axes. A line in space is then calculated for each of the rows. Roll of the tool is derived 
by combining the information from the calculated 3D lines from at least two of the 
rows. The two rows can also be used to increase accuracy and extend the range of the 
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coarse shift position determination. If the lines are parallel on the tool and the images 
of them are shown on a display, the operator of the working machine will have an 
intuitive sense of the orientation of the tool by looking at the display, since the lines 
will be angled to each other in relation to the rotation around a vertical axis. If the 
calculated points of balance also are shown along the lines then the operator will also 
have an intuitive sense of the roll of the tool, since the distance between the points on 
the lines will then be different in dependence of the distance to the tool at the viewed 
position. 

SHORT DESCRIPTION OF THE FIGURES 

The invention will now be described in more detail with reference to the 
accompanying drawings, in which 

FIG 1 illustrates schematically a first embodiment of a device according to the 
invention; 

FIGs 2A to 2F illustrate different kinds of code patterns to be provided onto the tool. 
FIG 3 illustrates schematically a second embodiment of a device according to the 
invention; and 

FIG 4 illustrates schematically a third embodiment of a device according to the 
invention. 

DETAILED DESCRIPTION OF EMBODIMENTS 

Referring to FIG 1, a tool 1, illustrated as a road grader blade, is movable in relation to 
a machine, here illustrated as a control cabin 2 for the operator (not shown). The tool 1 
is pivotably linked via, for example, a ball and socket joint to a bar 3, which in turn is 
pivotably linked to the machine. Thus, the tool 1 is pivotal around both the rotation 
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points A and B at the end of the bar 3. The position (shift and height) of the tool and 
its orientation are to be determined. 



At least one imaging area 4 (and 5), here represented by video cameras, are positioned 
in the vicinity of the control cabin 2. Preferably, two separate video cameras 4 and 5 
are provided and positioned on each side of the cabin 2. The reason is that the tool 1 
can be shifted so far that it comes outside the field of view of one of the cameras. Thus 
the problem which is solved by having two cameras is how to get a view of the tool all 
the time during a working operation. 

According to the invention measuring points are provided on the blade. The points are 
preferably markers or code objects having sizes and shapes which are clearly 
detectable when making image processing which will be described later on in the 
description. It is to be noted that the sizes of the markers must be so large that the 
shapes of them can be restored by the calculation of the image on each imaging area 
even though some dirt obscure a part of it. An image of a marker can also be obscured 
by some obscuring object positioned between the marker and the camera in question. 

The markers are appropriately provided on at least one, preferably two code strips 3 A, 
3B adhered to the blade and are facing towards the imaging area or areas 4, 5, 
henceforth called cameras. Each strip is provided with the markers or code objects 
easily recognisable and distinguishable by the cameras. 

Each of these code objects, below called markers, serve as measuring objects. 
However, measuring objects could also be easily distinguishable points on one and the 
same marker. If for instance a marker is a triangle, each apex of it could be used as a 
measuring object. The form of the marker is still reconstructable by the computation so 
that the distinguishable points can be reconstructed even if one of them is obscured by 
dirt. In a case like this it is the distinguishable points which are computed and not the 
point of balance. An unambiguous shift position can be obtained using markers of 
different shape and constellations. 
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If at least three or four points on a line in space (here three markers on one of the 
strips) having known mutual distances are recorded on an imaging area the equation of 
the line and the position of the points can be determined. If more than three points on a 
5 line (markers) are used, then a least square method could be used in order to determine 
the desired parameters in a more secure and exact way than with only three points, 
thus creating an over-determined system. An over-determinable system is preferred in 
a dirty and dirtying environment. 

10 When two or more lines of markers are used, then further conditions could be used in 
order to enhance the estimations and to determine the position and orientation in space 
of the imaged object in a three-dimensional system. These mathematical conditions are 
well known for the person skilled in the art and are therefore not described in detail. 
They are described for instance in the textbook by Haralick and Shapiro "Computer 

15 and Robot Vision", vol II. The invention is a way to make practical use of such 
conditions in a contactless measurement of a tool. The position and orientation in 
space could also be provided with markers or code objects spread in a predetermined 
way over the surface. However, use of lines lead to equations easy to solve, 
particularly if they are parallel, and are therefore preferable. Using the mathematical 

20 conditions desribed in the textbook above it could be possible to make three- 
dimensional determinations having only four or five measuring objects on the tool 
having known mutual positions. As mentioned above, several measuring objects are 
preferably used in order to create an over-determined system. 

25 Support for the roll-determination is also provided by using two or more lines of 

markers on the strips 3 A and 3B. As mentioned above, the code on each strip should 
preferably have some redundancy, i.e. more markers to measure than what is strictly 
needed for computations to calculate the position of a line in a 3D-co-ordinate system, 
since it is not possible to avoid that at least some of the markers and/or code objects 

30 will become very dirty during operation. An active lighting unit 6, 7 can be provided in 
order to enhance the visibility of the markers on the coded strips. 
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The redundancy can be provided by having the code pattern doubled or otherwise 
multiplied on each strip, as illustrated in the FIGs 2A to 2C The readability of the 
display areas can be checked by comparing the different parts of the image of the 
5 strips. If they are different as regards the pattern configuration, apart from size and 
inclination, then an indication is made to alarm the operator that the code is on the 
point of being too dirty. It is also possible and preferred to have a stored image of the 
patterns and to compare the pattern on the strip with the stored patterns in order to 
detect dirt on the code strips. 

10 

The displacements of the tool 1 can be large, particularly if the pivoting points are 
spaced a long distance apart from each other. Therefore, the distance from the cabin 2, 
and hence the cameras 4, 5, to the tool blade 1, or at least a part of it, can vary 
considerably, for instance 2 to 4 m. Shift and rotation around the point A can also 

15 cause the tool blade 1 to be moved out of the viewing imaging area of one of the 

cameras 4 or 5. Therefore, at least two cameras are preferably provided. The cameras 
are preferably provided at fixed locations and with fixed orientation on the wording 
machine in order to have as few movable parts as possible. However, if the tool is 
provided on for instance a bulldoozer, having two degrees of freedom with high lifts 

20 then the camera(s) are preferably turnable around a substantially horizontal axis in 

order not to loose sight of the markers, i.e. the markers must not be moved up or down 
out of sight of the imaging area(s). 

A bulldoozer blade often has only a limited moving pattern and can often not be turned 
25 in every possible direction. If the number of degrees of freedom is limited the number 
of markers could be reduced and the calculation be simplified. 

Since the instantaneous position of the blade is to be determined, a measuring 
frequency of between 1 to 50 Hz, preferably between 10 to 50 Hz, is desired. This 
30 means that the images of the coded strips are provided at the measuring frequency. 
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However, it is possible to determine shift position, rotation and roll at a lower 
frequency, i.e. making the more complicated calculations at greater intervals. 

Different kinds of code design are illustrated on FIGs 2A, 2B 5 2C, 2D, 2E, 2F. 

FIG 2A shows two code strips, one above the other and both provided with circular 
markers 8 at precise mutual spaces. The size and the distance to them from each of the 
cameras 4 and 5 are adapted such that the circular markers cover such a number of 
pixels in the camera image, and that such a number of them are shown in the image, 
that the position and orientation of a line going through them can be determined with 
an acceptable accuracy. As an example, a suitable diameter or diagonal size is 3 cm 
and a suitable distance apart is 6 cm, the pixel density is such that each object covers 
at least 100 pixels, and the image size is chosen such that at least ten objects are shown 
in the image, at least when the blade 1 is parallel to the cabin 2. 

FIG 2 A also illustrates that some of the markers could have another shape than the 
others. For example each fifth marker could be a square, as illustrated at 9, a triangle 
or the like instead of a circle 8. It is to be noted that the point of balance of each 
marker preferably should be placed on the same line 10 as the point of balance of the 
other objects. Having markers of different shapes makes it possible to exactly identify 
each marker on the blade in the image of each camera and hence the position of each 
of them. 

FIG 2B illustrates that the two parallel codes could have different shapes. In this way 
the positions of differently shaped markers could be uniquely determined by 
comparing the marker shapes one above the other in the two rows. It also illustrates 
that the rows of code markers could be provided on the same strip 1 1. In this 
embodiment each row has circles 13 and three differently shaped markers placed as the 
fifth object. These objects are a square 14, a triangle 15, a diamond 16 etc. However, 
the codes are differently ordered and permuted so that different kinds of the fifth 
element are placed one above the other on each position for a fifth element. In this 
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way, using the sizes of the code elements given as an example above, it is possible to 
get nine unique half-meter positions, and hence a good resolution could be provided 
for a length of the tool 1 up to at least 5 m. This code has the advantage that all 
distances between the markers (i.e. their points of balance) are equal, even though they 
5 are differently shaped. 



It is to be noted that the normal marker does not have to be a circle but another kind of 
object, for instance a polygon or the like. However, the markers preferably have a 
symmetric shape. 

10 

FIG 2C illustrates that extra symbols could be provided at the side of the circular 
objects and shows two parallel strips 18 and 19 where each circle 20 has another kind 
of symbolic object below, such as in cyclic order a square 21, a triangle 22, a diamond 
23 for the first three groups in the upper row, and groups of three symbolic objects of 

15 the same kind in cyclic order in the lower row. The reason for this is to create a 
uniquely determinable position for the markers when they are recorded. The forth 
group in the upper row has the symbolic object permuted in order to create a symbol 
order in which each combination of two symbol combinations of the upper and lower 
rows at the side of each other have different combinations. It is also possible to have 

20 symbols placed more sparcely in relation to the circular objects, for instance at each 
third such that the first three groups of symbolic objects will be enough for the marker 
rows. 

The reason to have only circular markers above (or beneath) the symbolic objects or 
25 markers is that it is easier to determine the point of balance in a circle (or the same 
kind of objects) than in differently shaped object and also that the identification of the 
symbolic objects can be made in a simple way. They do not even need to have their 
points of balance positioned on the same line, because it is the circular markers which 
are the markers from which the lines in space should be derived. The differently 
30 shaped symbol markers only serve a position identification purpose. 
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FIG 2D illustrates that the markers or measuring objects need not be provided on lines 
and thus could be predetermined but arbitrary spread over the tool surface. The 
computers are so powerful nowadays that all the needed information can be derived 
without placing the markers in an orderly way. Measuring could be provided to the 
tool onto known predetermined positions at the manufacturing. The positions of the 
markers on the image areas are then stored. The processor making the calculations will 
be provided with a program directly calculating and presenting the position, orientation 
and moving direction of the tool. 

The markers 26, 27, 28 need not have different shapes even though this is to be 
preferred. They need not either have the same size as illustrated at 28. Their different 
positions could be derivable from the particular pattern in which they are arranged on 
the tool. It is also illustrated that one marker could provide several measuring objects, 
such as the comers a, b, c, d of the square marker 28. It is to be noted that the comers 
could be restored even if all of them should happen to be obscured. 

FIG 2E illustrates that markers can be placed along at least two lines crossing each 
other, and FIG 2F that markers can be placed along vertical lines. The lines are 
illustrated to be placed at such short distances that the cameras 4, 5 can have least one 
of those lines in their field of view. 

The markers are preferably designed in a retro-reflective foil material. The background 
could be black and dull. This will minimise the disturbance from the light in the 
environment and also minimise the need of power supply for at least one active 
lighting unit 6, 7. 

It is to be noted that the measuring device must be able to work perfectly in spite of 
varying environment light. Thus, the lighting unit or units 6, 7 have to provide a light 
strong enough to give a reflection from the markers above the level of the ambient light 
reflected by the tool blade 1 and its code strips. Instead of having reflective markers 
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lights, such as light emitting diodes (LED), could be positioned on the tool blade and 
switched on during operation. However, this is not a preferred solution, even if it is 
possible, because of the vibration of the tool blade which makes the lighting circuitry 
sensitive and unreliable. 

The lighting units 6, 7 could be positioned on the cabin 2. However, a preferred 
position, shown in Fig. 1, is near to the camera optics, for instance a fitting 6, 7 
comprising a number of light diodes placed around each camera 4 and 5, respectively. 

Each camera 4 and 5 could be provided with an array (matrix) of CCD-detectors. Each 
camera could also be provided with a spectral filter 41, 51, respectively, transmitting at 
least the same wavelengths as the lighting units 6 and 7 in order to minimise the 
influence of ambient light and to enhance the signal-to-noise ratio. The bandwidth of 
the filter 41, 51 is rather narrow, for example about 50 nm. An interference filter 
having a transmittance around the wavelength of the lighting units 6 and 7 could then 
be used. Also, the bandwidth of the lighting units 6, 7 and the filters 41, 5 1 is 
preferably within a wavelength range in which the solar light levels are rather low. For 
instance, the lighting units could comprise light diodes having a wavelength of 950 nm, 
i.e. within the near infrared range. 

Each camera or two or more cameras in combination could be connected to at least one 
so called framegrabber 42, 52, respectively, for momentarily recording the images. The 
outputs from the framegrabbers are digitised representations of the images. The output 
from each framgrabber is stored at least momentarily in a store 45 or 55, respectively, 
in a calculating unit 30 for image processing, control and calculation. Each store could 
have a capacity to store more than one image at the time in order to ease the 
calculations, particularly since the movements of the line(s) in space should be 
derived. 

The information in the images of interest to be used are the positions and shapes of the 
markers. Thus, the image parts comprising these objects are segmented out from the 
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background, i.e. the background is discriminated. This is done by the image processor 
30, 31. The respective points of balance of the markers are calculated. The background 
discrimination level is adapted between the exposures by striving to have the same 
amount of objects in the images for different exposures and to check that the shape of 
the markers is the right one (for instance circular or oval). This criterion is a 
minimisation of the shape factor. 

In the embodiment shown in FIG 1, by processing of the images from the cameras the 
computer calculates the orientation of the space lines going through the lines of 
markers, for example provided on code strips 2 and 3. 

Since markers having different shapes than the others are used the positions of 
individual markers could be derived in relation to the tool blade 1. From the calculated 
momentary surface positions of the tool surface rotation, pitch and roll of the blade 
are then calculated. The movement speed in different directions and rotations could be 
derived and hence tool positions can be predicted at least a short time in advance. 

The image recordings and the calculations are performed at short intervals. The unit 30 
simultaneously switches on the lighting units 6 and 7 and the electronic shutters (not 
shown) of the cameras for a suitable period of time, for instance in the order of 
1/1000 s, as illustrated by the block 32. The image processing starts directly, and a 
new image recording is done. It is possible to have more than one processing circuits 
working in parallel but time shifted in order to be able to have a close repetition 
frequency. Preferably the internal circuits in the cameras, for instance the integration 
time control and AGC, controls the exposure to be optimum. 

In order to calculate the three-dimensional information derivable from the image data, 
the computer program first transmits the pre-processed data to a calibrated co-ordinate 
system. Checkpoints could then be provided in stored tables. It is also possible to let 
the computer program make a homogenous matrix multiplication. An over-determined 
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equation system is used for calculating the equations for the lines and the points of 



each line belonging to each individual code strip. 

The equations are based on mere geometrical considerations known for the person 
5 skilled in the art and are therefore not described in detail. Height, inclination and 
rotation are derived directly from the results of the calculations. Roll is derived by 
combining information from two rows of markers. Shift is determined by interpretation 
of the code such that a code point having a known position is related to its position on 
the blade. Such markers are thus provided on each code strip as described above. 

10 

The measures described above only provide the movements of the blade 1 in relation 
to the cabin 2. The speed, actual position and orientation of the vehicle having the tool 
blade 1 is measured in another conventional way. 

15 However, in accordance with a second embodiment of the invention, shown in FIG 3, 
blade speed in relation to the ground is also derivable, at least when the blade is in 
contact with the ground. This embodiment also illustrate that it is possible to have only 
one camera 61, which then is placed on the front of the cabin 62. The camera 61 can 
have a field of view such that not only the blade but also the ground are recorded on its 

20 image plane, or alternatively have a part of its field of view by a divisional optics 63 
directed towards the lower part of the tool. Preferably, the divisional optics is fixed 
and calibrated at the installation. 

Alternatively and preferably, as shown in FIG 4, besides the camera 61a separate 
25 camera 65 is provided on the cabine 62 and directed such that both the blade and the 
ground are viewed and recorded. The image processing in a processing device 66 of 
the recorded image of the ground and at least a part of the ground demands a more 
powerful computation than the computation in the processing device 67 for the 
markers on the tool blade 68 using for instance correlation techniques. 



30 
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Since the movements of the tool blade 1 in relation to the cabin 2 are monitored and 
calculated it is possible to servo control the direction of the divisional optics 63 of the 
divisional optics through a direction controllable mounting device 64 onto which the 
divisional optics are mounted, or the extra camera 65 from the processing device 66 
such that the blade edge always lies at a pre-determined position in the part of the 
image or the image, respectively, showing the blade edge 69 together with the ground. 
The servo control feature is, however, expensive and therefore it is preferred to have 
the divisional optics or the extra camera in a fixed position. 

While the invention has been described with reference to specific embodiments, it will be 
understood by those skilled in the art that various changes may be made and equivalents 
may be substituted for elements thereof and different features described for one 
embodiment could be adequate also in the other embodiments without departing from the 
true spirit and scope of the invention as it is stated in the claims on file. In addition, 
modifications may be made without departing from the essential teachings of the invention 
as apparent from the claims. For example at least one object position on the tool could be 
calculated making use of the image of the measuring objects on the image area(s) and be 
used to derive the 3D position of the tool and its 3D movement. 
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1. A method for contactless or touch-free measurement of a tool or accessories by 
means of at least one imaging area means (4,5) and calculation indicating the position 
and/or orientation of the tool making use of image points on the imaging area means, 
based on the image points having predetermined mutual positions provided on the tool, 
imaged onto the imaging area means, and optics presenting the image points on the 
tool on the imaging area means, the image points being at least three visible within the 
field of view of the imaging area means and at least one being distinctly identifiable, 
characterized by, in order to measure the position and/or orientation of the tool, 
providing a number of measuring elements (8,9; 13 to 16;20 to 23;26 to 28) on the tool, 
each measuring element having a size large enough for making a reconstruction of its 
form and calculation of at least one image point on the tool related to the measuring 
element even though a part of it happens to be obscured by some obscuring object, for 
example dust. 

2. Method according to claim 1, characterized in that at least some of the measuring 
elements, called lined measuring elements, are positioned on at least one row; and that 
for each row at least one 3D line going through the lined measuring elements for the 
row in question is determined. 

3. Method according to claim 1 or 2, characterized in that 

consecutive measurements of the measuring elements are provided, each measurement 
resulting in calculation of the 3D position and/or 3D orientation of the tool, and further 
calculations are performed to calculate the 3D movements of the tool from calculation 
to calculation and thereby to calculate at least one type of movement of the tool, such 
as shift, rotation etc. 

4. Method according to any of the preceding claims, characterized in that most of the 
measuring elements are markers having the same shape, for instance circular, and that 
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at least one of the markers has a shape different from the others, for instance a square, 
a triangle, a diamond or the like, clearly distinguishable in the imaging area means, 
each said differently shaped marker having a predetermined known position on the tool 
and deterrruning a reference point for determining shift position, and that a point or 
points on each marker are calculated to be used as the measuring point or points 
representing the marker. 

5. Method according to claim 4, characterized in that, in order to have a uniquely 
determined position for each differently shaped marker, the differently shaped markers 
having relation to different rows have a different order and/or different configurations. 

6. Method according to any of the preceding claims, characterized in that for each 
measuring element or marker its point of balance is detected and is used as a point 
representing the measured measuring element. 

7. Method according to any of the preceding claims, characterized in that at least two 
rows of markers are provided on the tool, and that a line going through each row 
and/or the position of at least one measuring element point on each row are 
determined. 

8. Method according to claim 7, characterized in that the rows of markers are parallel, 
the rows being either horizontal or vertical. 

9. Method according to any of claims 3 to 6 and claim 7 or 8, characterized in that 
roll of the tool is derived by combining the information regarding at least two of the 
rows. 

10. Device for contactless or touch-free measurement of a tool by means of imaging 
area means (4,5) and processing means (30) making calculations based on image points 
on the tool, imaged onto the imaging area means, and optics (41, 42;51,52) presenting 
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the image of the image points on the tool on the imaging area means, the processing 
means (30) being adapted to calculate the momentary position and/or orientation along 
at least one axis of the tool making use of the image points, 
characterized by 

5 a number of measuring elements and/or markers (8,9; 13-16;20-23;26-28) having 
predetermined mutual positions and being provided on the tool, each measuring 
element and/or marker comprising at least one measuring point, and at least one of 
them being identifiable; each measuring element and/or marker to be used as position 
and/or orientation indicating means having a size making it restorable by the 

10 processing means even if a part of it on the tool is obscured for the image area means, 
for example by dust. 

11. Device according to claim 10, characterized in that at least some of the measuring 
elements and/or markers, called lined measuring elements, are positioned on at least 
15 one row; and that for each row the processing means (30) determines at least one 3D 
line going through the lined measuring elements for the row in question and/or the 
equation of a least one line going through the measuring elements or markers provided 
in the same row. 

20 12. Device according to claim 10 or 1 1, characterized in that there are at least two 
rows of measuring elements or markers; and that the processing means (30) is adapted 
to make calculations of a line through each row and/or the position of at least one 
measuring element or marker on each row. 

25 13. Device according to claim 12, characterized in that the rows are parallel to each 
other, either horizontally or vertically. 



30 



14. Device according to claim 12, characterized in that the rows of markers 
extend along a line going from one end side of the tool to the other and are angled in 
relation to each other. 
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15. Device according to any of the claims 10 to 14, characterized in that the 
processing means (30) is adapted to make consecutive measurements to the measuring 
elements, each measurement resulting in the calculation of at least a line of the tool 

5 surface in space, and the processing means (30) is adapted to calculate movements of 
the tool in space between calculations and thereby to calculate at least one type of 
movement of the tool, such as shift, rotation etc. 

16. Device according to any of the claims 10 to 15, characterized in that at least most 
10 of the markers (8; 13;20) on the tool have the same shape, for instance circular, and that 

at least one marker (9; 14 to 16) is provided having a shape different from the others, 
for instance a square, triangle, diamond or the like, clearly distinguishable in the 
imaging area(s), each said differently shaped marker having a predetermined known 
position on the tool and in relation to a predetermined constellation of the others. 

15 

17. Device according to claim 16, characterized in that in that most of the measuring 
elements are positioned in at least one row, and that, in order to have a uniquely 
determinable position for each differently shaped marker, the markers having positions 
related to different rows have a different order and/or different configurations. 

20 

18. Device according to any of the claims 10 to 17, characterized in that each 
measuring element provided in a row of measuring elements used for the measurement 
is a part of a marker having a two-dimensional shape. 

25 19. Device according to any of the claims 10 to 17, characterized in that the 

processing means (30) detects the point of balance in a marker and uses it as one of the 
measuring points. 



30 



20. Device according to any of the claims 10 to 19, characterized in that the 
processing means (30) calculates shift of the tool by detecting different spatial 
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positions of the differently shaped marker or markers in the consecutively made 
measurements. 

21. Device according to any of the claims 10 to 20, characterized in that the markers 
5 (8,9;13-15;20-23) are reflective and provided on a dull background, and by lighting 
units (6,7) illuminating the markers at least during the imaging of the imaging areas 
(4,5). 
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